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Preface 


The  seeds  of  motivation  for  choosing  this  particular  topic  were  planted  in  my  head 
years  ago.  I  have  been  in  the  acquisition  community  for  the  vast  majority  of  my  Air  Force 
career,  and  I  have  had  the  pleasure  and  the  pain  of  serving  for  numerous  Program 
Directors,  both  mihtary  and  civihan.  They  have  covered  the  waterfront  in  terms  of 
leadership  and  management  abihty.  Without  exception,  they  have  all  been  extremely 
inteUigent,  technically  astute  individuals.  Some  complemented  this  technical  abihty  with 
equaUy  outstanding  leadership  abihties.  Unfortunately,  the  majority  of  them  did  not.  As  a 
result,  morale  suffered  in  those  program  offices  and  I  saw  officers  and  civihans  with 
unlimited  potential  leave  government  service  because  they  were  disiUusioned  with  the 
future  they  saw.  I  myself  found  it  disconcerting  (and  somewhat  embarrassing)  that  the 
senior  officers  who  were  supposed  to  be  our  role  models  of  leadership  appeared  to  be 
falling  down  on  the  job.  I  saw  the  Program  Directors  as  managers,  not  leaders. 

Here  at  Air  Command  and  Staff  CoUege,  reading  Carl  Builder’s  book.  The  Icarus 
Syndrome,  struck  a  chord  with  me  because  his  premise  seemed  to  confirm  my 
observations.  Occupationahsm  was  taking  over  the  Air  Force — speciahsts  were  more 
concerned  with  their  specific  career  field  than  the  Air  Force  as  an  institution.  In  the 
acquisition  world,  that  manifested  itself  in  managers  with  no  leadership  abihty.  It  was  at 
that  point  in  the  academic  year  when  I  decided  that  I  wanted  to  explore  ways  to  reverse 
the  occupational  trend  in  my  career  field. 
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Abstract 

The  central  issue  of  this  paper  addresses  the  lack  of  leadership  in  the  acquisition 
career  field  and  what  can  be  done  to  correct  it.  The  current  environment  within  the  Air 
Force  poses  a  great  leadership  challenge  to  all  officers,  regardless  of  career  field. 
However,  the  occupationahsm  that  the  service  has  fostered  over  the  years  has  resulted  in 
officers  in  the  acquisition  career  field  focusing  on  enhancing  their  managerial  skills  at  the 
expense  of  their  leadership  quahties.  As  a  result,  many  Program  Directors  are  excellent 
managers,  but  lack  even  basic  leadership  skills. 

The  lack  of  statutory  or  Air  Force  Materiel  Command  (AFMC)  emphasis  on 
leadership  in  the  process  of  selecting  Program  Directors  has  perpetuated  the  managerial 
occupationahsm  that  exists  today.  An  objective  measure  of  leadership  abihty  must  be 
factored  into  the  existing  selection  process  to  ensure  that  personnel  selected  to  fiU  critical 
Program  Director  positions  have  the  demonstrated  leadership  potential  needed  to  lead 
Program  Offices  into  the  21st  century. 

Assessment  Centers  represent  the  most  sophisticated  means  of  assessing  leadership 
abihty  and  potential.  The  workings  of  these  centers  is  discussed  fohowed  by  a 
recommendation  to  estabhsh  such  a  center  at  AFMC  Headquarters  to  provide  the 
objective  measure  of  leadership  needed  as  a  selection  criteria  and  to  provide  acquisition 
personnel  with  much  needed  feedback  on  their  leadership  strengths  and  weaknesses. 


vr 


A  survey  of  current  literature  on  leadership,  management,  and  issues  and  studies  on 
the  acquisition  career  field  provide  the  support  for  the  contentions  and  recommendations 
put  forth  in  this  report. 
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Chapter  1 


Leadership  Challenge  in  Acquisition 

Where  have  all  the  leaders  gone? 

— Major  Dennis  Drayer,  USAF 
“Where  have  all  the  Leaders  Gone?” 

The  post  Cold  War  era  in  the  United  States  has  been  characterized  by  a  mihtary 
drawdown  to  levels  not  seen  since  the  days  following  the  end  of  World  War  11. 
Manpower  and  funding  levels  have  been  cut  drastically.  As  these  budget  cuts  continue, 
the  Air  Force  acquisition  community  faces  significant  challenges  in  its  mission  to  provide 
the  warfighters  with  effective  weapon  systems  in  a  timely  manner  to  support  operational 
requirements.  “Do  more  with  less”  is  a  phrase  that  everyone  in  the  acquisition  community 
has  become  famihar  with.  Acquisition  programs  with  exceedingly  complex  development 
and  procurement  cycles  are  being  executed  with  less  personnel  and  resources  to  manage 
them.  In  this  increasingly  competitive  environment,  it  is  imperative  that  our  Program 
Directors  be  good  leaders,  not  just  good  managers.  Unfortunately,  the  honing  of  mihtary 
leadership  skiUs  has  taken  a  back  seat  to  careerism  and  the  development  of  managerial 
skills  in  the  acquisition  career  field. 


1 


stovepiping 


There  is  a  common  belief  in  the  Air  Force  today  that  aircraft  and  technology  have 
become  an  end  in  itself  rather  than  a  means  to  achieving  an  end.  As  a  result  of  this,  the 
accomphshment  of  missions  has  been  lost  as  a  primary  focus  in  the  Air  Force,  resulting  in 
a  weaker  sense  of  community  than  the  other  services.  More  than  any  other  service,  the 
Air  Force  has  moved  away  from  an  institutional  value  system  toward  an  occupational  one, 
due  primarily  to  its  dependency  on  technology  and  speciahsts.  Surveys  support  the 
conclusion  that  the  Air  Force  is  tending  toward  occupationahsm.  ^  Air  Force  people  are 
increasingly  favoring  their  own  careers  and  interests  over  that  of  the  Air  Force  mission  or 
institution.^  In  the  acquisition  career  field,  this  trend  manifests  itself  in  senior  personnel 
who  have  keenly  developed  managerial  skills,  but  lack  some  of  the  most  basic  mihtary 
leadership  traits. 


Manager  vs.  Leader 

The  Reagan  Administration  era  was  the  best  of  times  for  the  acquisition  community. 
A  massive  mihtary  buildup  resulted  in  manpower  levels  exceeding  100%  of  requirements, 
and  a  plethora  of  new  weapon  system  program  starts  with  an  abundance  of  funds  to  spend 
on  research,  development,  and  procurement.  Comparing  that  environment  with  the  one 
we  find  ourselves  in  today,  most  acquisition  career  field  observers  would  agree  with  an 
industry  executive’s  comment  that  “...in  the  past  we  didn’t  need  many  leaders.  But  now, 
in  a  more  competitive  environment,  we  surely  do.  What  we  have  currently  is  a  couple  of 
good  managers  who  can  lead,  a  lot  of  very  good  managers  who  can’t  lead,  and  hordes  of 
great  administrators.”^  The  frugal  budgetary  situation  we  find  ourselves  in  now  results  in 
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procurement  numbers  being  reduced  and  stretched  out  over  a  longer  period  of  time. 
Coupled  with  manpower  cuts  in  some  program  offices  of  up  to  50%,  we  are  expecting 
those  programs  to  take  on  more  comphcated  tasks  with  less  resources.  Accomphshing  the 
mission  is  no  longer  just  a  matter  of  good  managerial  technique — it  is  a  daunting  task  that 
requires  strong  leadership. 

Most  acquisition  programs  today  are  overmanaged  and  underled  because  few 

program  directors  understand  what  leadership  is  and  what  it  can  accomphsh  for  them."^ 

Many  program  directors  today  spent  the  majority  of  their  careers  in  the  acquisition  career 

field.  They  are  speciahsts  who  have  embraced  their  “occupation”,  developing  sound 

managerial  skills  at  the  expense  of  their  higher  caUing  to  be  Air  Force  leaders.  Program 

Directors  need  to  understand  the  difference  between  management  and  leadership.  As  Maj 

Dennis  Drayer  points  out,  this  is  a  difficult  problem  to  overcome: 

The  problem  is  that  leadership  is  something  cultivated  during  a 
considerable  period  of  time,  through  a  combination  of  inherent  capacity, 
early  childhood  experiences,  formal  education,  and  career  experiences. 

Formal  education  can  supplement  and  build  on  the  attributes  required  of 
effective  leaders,  but  it  cannot  create  the  motivation,  develop  the  personal 
values,  intensify  the  abihties  and  skills,  improve  the  reputation,  build  the 
relationships,  or  infuse  the  career  of  experiences  required  of  an  effective 
leader.^ 

This  quote  reinforces  the  arguments  made  by  Builder  that  the  Air  Force  has  embraced 
occupationahsm  and  does  not  have  a  clear  unifying  vision  for  all  members  of  the  force.  In 
the  acquisition  field,  that  translates  to  a  corps  of  effective  managers,  not  mihtary  leaders. 
The  motivation,  personal  values  and  career  experiences  of  these  officers  encourage  the 
development  of  management  skills,  not  leadership. 
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Good,  Fast,  Cheap — Pick  any  Two 


Most  people  have  heard  the  old  saying,  “You  can  have  it  good,  fast,  or  cheap.  Pick 
any  two.”  In  the  acquisition  world  today.  Program  Directors  are  being  tasked  to  get  all 
three.  In  order  to  accomphsh  this  objective,  changes  need  to  be  made  in  the  way  System 
Program  Offices  get  things  done.  Capt  Joseph  Veneziano  beheves  we  can  do  this  by 
cultivating  Program  Directors  who  are  visionary  leaders  to  overcome  what  he  calls 
“Acquisition’s  Seven  Cardinal  Sins”'’: 

1 .  Not  satisfying  user  requirements 

2.  Common  goals  but  uncommon  objectives  (different  motivating  factors) 

3.  Adversarial  relationships  among  government,  contractor,  and  user,  which  destroy 
trust 

4.  Low  morale  among  program  office  personnel 

5.  No  clear  lines  of  communication 

6.  Lack  of  understanding  of  the  big  picture 

7.  Inefficient  processes,  duphcation  of  efforts,  and  lack  of  understanding  of  roles  and 
relationships,  resulting  in  overworked,  underutilized  employees 

To  overcome  these  problems,  Capt  Veneziano  submits  that  a  return  to  basics, 
emphasizing  fundamental  leadership  principles  such  as  motivation,  delegation, 
communication,  vision,  and  inspiring  trust  are  required.  On  the  other  hand,  one  could 
posit  that  the  lack  of  current  leadership  is  a  major  contributing  factor  to  these  “Sins” 
existing  (to  varying  degrees)  in  the  first  place. 

Where  do  we  go  from  here? 

Clearly,  the  current  environment  within  the  Air  Force  poses  a  great  leadership 
challenge  to  all  officers,  regardless  of  career  field.  However,  the  occupationahsm  that  the 
service  has  fostered  over  the  years  has  resulted  in  officers  in  the  acquisition  career  field 
focusing  on  enhancing  their  managerial  skills  at  the  expense  of  their  leadership  quahties. 
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In  the  past,  this  focus  on  management  did  not  have  an  adverse  impact  on  the 


accomphshment  of  the  mission.  However,  the  austere  conditions  that  program  offices  are 
forced  to  operate  in  today  require  a  focus  on  leadership  in  order  to  be  successful.  The 
next  chapter  wiU  discuss  the  difference  between  a  manager  and  a  leader,  as  well  as  a 
description  of  the  current  process  used  for  selection  of  senior  program  directors  in  the  Air 
Force. 


Notes 

^Carl  H.  Builder.  The  Icarus  Syndrome.  New  Brunswick  NJ:  Transaction  Pubhshers, 
1994,  pp.  6-8. 

^Ibid.,  pg.  20. 

^Drayer,  pg.  26. 

"^Ibid.,  pg.  31. 

^Ibid.,  pg.  31. 

'’Capt  Joseph  Veneziano.  “Getting  Back  to  Basics  in  the  Acquisition  Workforce”, 
Program  Manager,  Sep-Oct  1996,  pg.  14. 
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Chapter  2 


The  Leadership  Distinction 

Overall,  personal  requirements  for  effective  management  are  different 
from  and,  in  many  ways,  simpler  than  leadership  requirements.  Relatively 
speaking,  it  requires  considerably  more  to  provide  effective  leadership. 

— Major  Dennis  Drayer,  USAF 
“Where  have  all  the  Leaders  Gone?” 

Leaders  manage  and  managers  lead,  but  the  two  activities  are  not  synonymous.  The 
purpose  of  management  is  to  keep  systems  running  in  line  with  estabhshed  criteria.  Thus, 
managers  traditionally  have  been  identified  as  performing  the  planning,  investigating, 
coordinating,  organizing,  and  controlling  functions  in  an  organization.  Face  to  face 
interactions  of  managers  with  subordinates  receive  relatively  httle  attention  from 
management  theorists.  These  superior/subordinate  relationships  are  generally  seen  as 
leadership  functions.  Leaders  focus  more  on  resolving  conflicts  in  groups,  providing 
emotional  support  to  group  members,  maintaining  group  cohesiveness  and  satisfaction, 
and  working  with  group  members  to  set  group  goals. ^  The  strong  interpersonal  skills 
necessary  for  leadership  are  not  inherent  in  management  functions. 

The  interpersonal  aspects  of  leadership  can  be  found  throughout  the  hterature  on  the 
subject.  The  current  Chairman  of  the  Joint  Chiefs  of  Staff,  Gen  John  M.  Shahkashvih,  at  a 
ROTC  Award  Seminar  said,  “Good  leadership... is  based  essentially  on  three  pillars: 
Character,  love  and  care  for  soldiers,  and  professional  competence.”^  Gen.  S.L.A. 
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Marshall  also  stressed  the  personal  aspects  of  leadership,  “Human  relations  wiU  always 
play  a  vital  part  in  the  advancement  of  a  leader.  They  become  the  mainspring  of  success.”^ 
Gen  HoweU  M.  Estes  III,  speaking  on  leadership  at  ACSC,  stated  that  creating  the  right 
climate  for  leadership  involves  having  good  communications,  mutual  respect,  trust, 
compassion,  and  integrity.  Finally,  Maj  Gen  Aubrey  Newman  said,  “...nothing  can  replace 
the  most  effective  principle  of... leadership:  the  day-to-day  personal  interest  of  the 
commander.”"^  Countless  other  examples  exist,  citing  traits  such  as  energy,  vitahty, 
charisma,  inspiration,  decisiveness,  caring,  patience,  foresight,  wisdom,  fairness  and 
confidence. 

Clearly,  management  (process)  and  leadership  (interpersonal)  traits  are  both  required 
for  a  Program  Director  to  most  effectively  run  a  program  office  and  accomphsh  the 
mission.  The  interpersonal  leadership  skills  are  necessary  to  maintain  morale  and  unit 
cohesiveness;  however,  it  is  also  imperative  to  have  the  necessary  functional  management 
expertise  and  experience  to  enable  a  leader  to  direct  and  guide  a  unit  in  its  day  to  day 
activities.  However,  Air  Force  Materiel  Command  has  emphasized  management  skills  to 
the  extent  that  they  have  completely  excluded  leadership  quahties  as  selection  criteria  for 
Program  Director  billets. 


Fill  the  Squares 

The  criteria  used  for  certification  of  program  management  personnel  is  contained  in 
DOD  5000. 52-M,  Career  Development  Program  for  Acquisition  Personnel.  The  three 
successive  levels  of  certification  each  require  personnel  to  meet  requirements  in  four  areas: 
Assignments,  Experience,  Education,  and  Training. 
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The  assignments  criteria  range  from  engineering  or  program  management  staff  officer, 
laboratory  staff,  or  test  and  evaluation  staff  at  Level  I  up  through  Acquisition  Command 
HQ,  Service  HQ,  Program  Office,  and  Broadening  (Operational)  assignments  for  Level 
III.  The  intent  of  this  it  to  provide  acquisition  managers  with  exposure  to  different  facets 
of  the  acquisition  community  to  provide  breadth  of  knowledge  and  experience. 

Experience  is  based  solely  on  time  served  in  acquisition  positions,  with  times  ranging 
from  1  year  for  Level  I  up  to  4  years  (of  which  2  must  be  in  a  program  office  or  similar 
organization)  for  Level  III.  Once  again,  the  intent  is  to  ensure  that  personnel  have  served 
an  appropriate  amount  of  time  in  acquisition  related  positions  before  certifying  them  at  the 
next  higher  level. 

The  educational  requirements  at  all  levels  of  certification  are  desired,  not  mandatory. 
Level  I  hsts  a  Bachelor’s  degree  in  business  or  a  technical  disciphne.  Levels  II  and  III 
certification  criteria  hst  a  Master’s  degree  in  engineering,  systems  management  or  other 
appropriate  field.  ^ 

These  three  areas  do  a  good  job  of  ensuring  functional  knowledge,  time  in  service, 
and  technical  expertise  are  sufficient  to  handle  the  increased  responsibihties  encountered 
as  a  Program  Director.  The  fourth  category.  Training,  is  the  one  where  the  cultivation  of 
leadership  skills  could  be  encouraged.  Unfortunately,  httle  to  no  emphasis  is  placed  on  it. 
The  only  mandatory  training  occurs  at  Levels  I  and  11.  The  Basic  (Level  I)  and 
Intermediate  (Level  II)  Systems  Acquisition  Courses  are  the  only  mandated  courses  that 
must  be  taken  to  be  certified  at  the  aforementioned  levels.  At  Levels  II  and  III,  the 
Defense  Systems  Management  College  (DSMC)  Program  Management  Course  and  other 
“Management  and  Leadership  Training”  is  hsted  as  desired,  but  not  mandatory.  This  is 
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the  only  place  that  leadership  is  mentioned  at  all.  This  sends  a  message  that  reinforces  the 
occupationahst  attitude  of  many  officers  today.  It  is  mandatory  to  be  a  good  manager  in 
the  acquisition  field;  having  good  leadership  skills  is  nice,  but  only  “desired”.'’ 

Concurrent  with  Level  II  certification,  personnel  are  expected  to  meet  the  criteria  for 
the  Acquisition  Corps.  The  intent  of  this  corps  is  to  ensure  that  a  group  of  highly  quahfied 
and  trained  personnel  is  available  to  fill  the  critical  acquisition  positions  within  DOD. 
Membership  in  this  corps  is  mandatory  in  order  to  fill  a  senior  acquisition  position  such  as 
Program  Director  or  Deputy  of  a  major  or  significant  nonmajor  defense  acquisition 
program.  Additional  criteria  over  and  above  those  previously  fisted  include  serving  in  the 
grade  of  GS-13  or  0-4  and  above,  and  completion  of  24  semester  credit  hours  from 
among  the  following  disciplines:  Accounting,  Business  Finance,  Law,  Contracts, 
Purchasing,  Economics,  Industrial  Management,  Marketing,  Quantitative  Methods,  and 
Organizational  Management.  Once  again,  no  mention  is  made  of  leadership.^ 

These  criteria  provide  the  statutory  minimum  requirements  that  must  be  met  for 
acquisition  certification  and  selection  to  certain  high  level  positions.  However,  this  does 
not  preclude  additional  requirements  being  levied  by  the  individual  services.  In  the  Air 
Force,  the  office  responsible  for  fifiing  Program  Director  positions  is  HQ  AFMC/DP.  The 
process  they  use  to  fill  these  positions  is  very  subjective.  They  begin  with  a  computer 
printout  of  all  acquisition  personnel  who  meet  the  criteria  for  assignments,  experience, 
education,  and  training.  A  records  review  (to  include  OPR’s,  training  reports,  and  any 
other  appropriate  documentation)  is  then  accomplished  to  get  a  picture  of  each 
individual’s  duty  history  and  performance.  AFMC  believes  that  this  review  provides  a 
good  measure  of  leadership  qualities  and  uses  it  as  a  key  determinant  in  selecting 
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candidates.  However,  the  subjectivity  and  inflation  of  OPR’s  and  training  reports  calls 
into  question  the  vahdity  of  this  process.  Once  the  review  has  been  completed,  the  hst  of 
candidates  is  given  to  the  commanders  of  the  various  acquisition  centers  (Aeronautical 
Systems  Center,  Electronic  Systems  Center,  Space  Systems  Center,  and  Human  Systems 
Center)  for  final  screening.  The  personnel  that  make  it  through  these  screens  fiU  available 
Program  and  Deputy  Program  Director  billets.^ 

The  lack  of  statutory  or  AFMC  emphasis  on  leadership  in  this  process  perpetuates  the 
managerial  occupationahsm  that  exists  today.  What  is  sorely  needed  is  an  objective 
measure  of  leadership  abihty  that  can  be  factored  into  the  existing  selection  process  to 
ensure  that  the  personnel  selected  to  fiU  critical  Program  Director  positions  have 
demonstrated  the  leadership  potential  needed  to  lead  Program  Offices  into  the  21st 
century.  Assessment  centers  represent  the  most  sophisticated  means  of  assessing 
leadership  abihty  and  potential.^  Implementing  an  assessment  center  at  AFMC  would 
provide  decision  makers  with  the  objective  measure  of  leadership  that  is  clearly  needed  as 
an  additional  selection  criteria.  The  chapters  to  foUow  wiU  describe  what  assessment 
centers  are,  how  they  operate,  and  how  they  could  be  used  in  AFMC. 


Notes 

^Richard  F.  Hughes  and  others.  Leadership:  Enhancing  the  Lessons  of  Experience. 
Boston  MA:  Richard  D.  Irwin,  Inc.,  1993,  pg.  61. 

^Gen  John  M.  Shahkashvih.  “Three  PiUars  of  Feadership”,  Defense  Issues  vlO  n42, 
1995,  pg.  1. 

^Gen  S.F.A.  MarshaU.  The  Officer  as  a  Leader.  Harrisburg  PA:  Stackpole  Books, 
1966,  pg.  163. 

"^Maj  Gen  Aubrey  Newman.  Eollow  Me  II:  More  on  the  Human  Element  in 
Leadership.  Novato  CA:  Presidio  Press,  1992. 

^Dept  of  Defense  5000. 52-M,  Career  Development  Program  Eor  Acquisition 
Personnel.  Washington  DC,  November  1991,  pp.  A. 1-7  to  A. 1-9. 

'’Ibid. 
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Notes 


^Ibid. 

^Telecon  with  AFMC/DPO,  31  Dec  96. 
^Hughes,  pg.  73. 
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Chapter  3 


The  Assessment  Center  as  an  Evaluation  Tool 

Assessment  is  the  state  of  the  art  technology  in  leader  development.  To 
ignore  it  would  be  to  ignore  developing  quality  leaders  for  the  future. 

— Major  Joseph  R.  Palmer,  USA 
“Competency  Based  Leadership” 

Historical  Background 

Although  assessment  centers  are  in  widespread  use  in  civilian  industry  today,  their 
origin  can  be  traced  back  to  the  German  Army  psychologists’  use  of  these  methods  to  aid 
in  the  selection  of  officers  in  World  War  1.  After  WWI,  the  British  adapted  the  German 
techniques  for  inclusion  in  their  officer  candidate  selection  process/  This  approach  was 
brought  to  the  United  States  and  used  by  the  Office  of  Strategic  Services  (OSS)  to 
evaluate  the  suitabihty  of  candidates  to  serve  in  overseas  posts  during  World  War  II/  The 
OSS  (the  forerunner  of  the  CIA)  considered  the  program  to  be  highly  successful  and  at  the 
end  of  the  week  long  assessment  candidates  were  either  accepted  or  rejected  based  on 
their  performance  in  the  assessments/ 

In  the  1950’s,  civihan  industry  began  to  pick  up  on  the  potential  uses  of  this  analysis 
technique.  Dr.  Douglas  Bray  was  hired  by  AT&T  to  use  assessment  centers  to  evaluate 
the  management  potential  of  their  young  managers.  His  program  was  known  as  the 
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Management  Progress  Study.  “No  doubt  this  early  study  has  played  an  important  role  in 
estabhshing  the  vahdity  of  the  assessment  center  approach;  the  reported  results  of  the 
management  progress  studies  confirmed  the  high  predictive  power  of  the  assessment 
techniques  to  subsequent  performance.”  By  the  mid  1980’s,  over  2500  civihan 
organizations  such  as  IBM,  Sears,  General  Electric,  and  Caterpillar  Tractor  were  using 
assessment  centers  to  select  potential  managers."^ 

Although  the  mihtary  played  the  initial  role  in  introducing  assessment  techniques,  their 
use  was  essentially  ignored  until  the  mid  1970’s.  The  Army  estabhshed  an  assessment 
program  for  use  in  selecting  ROTC  candidates  and  recruiters  in  1974^ and  the  Air  Force 
began  to  explore  the  feasibihty  of  estabhshing  an  assessment  center  at  Squadron  Officers 
School  in  1975.*^  By  1983  the  Air  Force  Office  of  Special  Investigations  (AFOSI)  had 
adopted  the  assessment  center  concept  for  identifying  officers  for  command  positions  and 
the  development  of  leadership  and  management  skills  in  ah  AFOSI  officers.  Their  center 
was  named  the  Commander  Development  Center  and  began  operations  at  Bohing  AFB  in 
March  1986.^ 

The  largest  mihtary  undertaking  to  date  has  been  the  implementation  of  the 
Feadership  Assessment  and  Development  Program  (FADP)  in  the  US  Army  Training  and 
Doctrine  Command  (TRADOC)  school  system  in  late  1991.  FADP  has  been  introduced 
in  all  resident  leader  training  courses  longer  than  five  weeks.  The  goals  of  FADP  are: 

1.  Give  student  leaders  accurate  assessments  of  their  demonstrated  leadership 
performance 

2.  Use  assessment  feedback  to  help  student  leaders  prepare  self  development  plans  to 
improve  their  leadership  performance 

3.  Help  student  leaders  become  more  effective  by  better  understanding  themselves 

4.  Famiharize  student  leaders  with  the  leadership  assessment  process  so  they  can  use 
it  to  develop  their  subordinate  leaders  in  future  assignments 


13 


5.  Establish  and  maintain  the  proper  school  learning  environment  to  develop  leaders 
with  the  needed  skills,  knowledge  and  attitudes^ 

The  trend  clearly  has  been  toward  more  widespread  use  of  the  assessment  center 
technique  throughout  civihan  industry;  the  mihtary  has  been  somewhat  slower  to  catch  on 
but  is  beginning  to  appreciate  its  value.  TRADOC’s  LADP  assessment  center  could  be  an 
invaluable  role  model  for  AFMC  in  developing  its  own  center  for  assisting  Air  Force 
program  managers  to  become  better  leaders. 

What  is  an  Assessment  Center? 

An  assessment  center  is  a  method  by  which  participants  are  evaluated  for  selection, 
placement,  development  or  promotion.^  However,  unhke  most  other  evaluative  programs, 
the  assessment  center  approach  is  future  oriented.  The  structured  evaluation  process 
utihzes  a  variety  of  exercises,  written  instruments  and  multiple  independent  observations 
to  provide  information  about  a  leader’s  readiness  or  potential  to  lead  effectively  in  a 
particular  position  or  level  within  an  organization.^'’  These  multiple  methods  of  assessment 
are  designed  to  ehcit  behaviors  and  responses  that  are  related  to  the  specific  competencies 
that  have  been  identified  by  the  sponsoring  organization  as  being  important  to  job  success. 
“The  overwhelming  results  indicate  that  assessment  centers  can  accurately  predict,  with  a 
high  degree  of  vahdity,  future  job  performance,  promotions,  and  demotions,  as  weh  as 
progress  or  lack  of  progress  in  a  career  field.”" 

What  is  assessed? 

Assessment  centers  are  individuahy  tailored  to  observe  and  evaluate  specific 
competencies  that  have  been  identified  as  being  critical  factors  in  successful  future  job 
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performance.  Most  often  included  in  this  list  are  skills  such  as  oral  and  written 
communication,  decision  making,  problem  solving,  time  management,  flexibihty,  energy, 
delegation,  etc.  A  current  mihtary  example  would  be  LADP,  which  has  identified  nine 
“competencies”  that  are  evaluated  at  their  assessment  center: 

1.  Communications 

2.  Supervision 

3.  Teaching  and  counseling 

4.  Soldier  team  development 

5.  Technical  and  tactical  proficiency 

6.  Decision  making 

7.  Planning 

8.  Use  of  available  systems 

9.  Professional  ethics 

How  are  competencies  assessed? 

A  wide  variety  of  tools  can  be  used  that  are  designed  to  highhght  the  behaviors  and 
traits  of  interest.  Candidates  are  commonly  subjected  to  psychological  and  personahty 
type  tests,  interviews,  and  written  and  oral  exercises,  as  well  as  situational  tests  such  as 
leaderless  group  discussions,  in-basket  exercises,  and  simulated  counsehng  sessions  with 
subordinates. 

Psychological  tests  such  as  the  Miner  Sentence  Completion  Scale  measures  areas  such 
as:  attitude  toward  authority,  the  desire  to  be  assertive,  actively  exercise  power,  stand  out 
from  a  group,  and  the  wiUingness  to  carry  out  routine  work.  The  Thematic  Apperception 
Test  requires  individuals  to  look  at  pictures  of  people  in  ambiguous  situations  and  make 
up  a  story  based  on  their  perception  of  the  picture.  Their  response  reveals  clues  about 
their  aspirations  and  provides  a  measure  of  a  person’s  underlying  need  for  power, 
achievement,  and  affiliation.^^ 
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Leaderless  group  discussions  involve  placing  candidates  in  a  group  with  no 
designated  leaders  and  are  instructed  to  represent  competing  or  opposing  viewpoints. 
Each  person’s  mission  is  to  persuade  the  others  to  adopt  his  or  her  viewpoint.  In-basket 
tests  present  the  participant  with  an  in-basket  full  of  reports,  letters,  and  memos  and  a 
limited  amount  of  time  to  process  the  paperwork,  making  all  necessary  decisions  as 
required.  In  both  of  these  exercises,  assessors  can  observe  skills  such  as  initiative, 
persuasiveness,  assertiveness,  dominance,  and  cooperation.^"^ 

In  aU  of  these  and  other  similar  scenarios,  participants  experience  the  typical 
problems,  frustrations,  and  pressures  they  would  be  subjected  to  on  the  job.  Their 
responses  to  the  situations  form  the  basis  for  the  feedback  they  receive. 

Who  does  the  assessing? 

Assessment  opportunities  can  come  from  a  number  of  different  sources.  At  LADP, 
there  are  three  sources,  called  “eyes”  because  they  provide  the  leader  a  different  look,  and 
when  combined,  present  a  total  view  of  the  leader.  AU  three  “eyes”  are  based  on  the  nine 
leadership  competencies  identified  by  TRADOC  for  feedback.  Self  assessment  is 
completed  by  the  participant  and  typicaUy  involves  psychological  measurement 
instruments,  Myers  Briggs  Type  Indicator  tests,  and  other  self  assessment  forms.  It 
provides  the  leader  with  a  look  at  himself  based  on  his  own  perceptions.  Associate  (peer) 
assessment  comes  from  other  participants  and  provides  feedback  on  how  other  candidates 
see  them  and  usuaUy  is  completed  by  using  a  competency  based  assessment  form. 
Cadre/superior  assessment  lets  the  leader  look  at  himself  through  the  eyes  of  experienced 
assessors  who  are  trained  to  evaluate  performance  in  leadership  situations,  such  as  the 
leaderless  group  discussion  or  in-basket  exercise.  A  fourth  possible  source  of  feedback 
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would  be  a  subordinate  assessment.  The  important  point  to  highlight  is  that  multiple 
sources  of  assessment  are  used  to  provide  a  more  complete  picture  of  the  subject  being 
evaluated. 

How  are  assessments  used? 

Assessment  results  typically  serve  two  primary  functions.  They  can  be  used  for 
developmental  feedback  to  the  individual,  or  they  can  be  used  as  selection  criteria  for  a 
particular  position. 

At  TRADOC,  assessments  are  used  to  provide  feedback  on  a  student  leader’s 
strengths  and  weaknesses.  A  faculty  counselor  gives  nonthreatening  developmental 
feedback  that  can  be  used  by  the  student  to  identify  areas  that  need  further  development  in 
order  to  be  prepared  for  future  levels  of  responsibihty.^'’  On  the  other  hand,  in  the  civihan 
world,  assessments  are  often  used  as  selection  criteria  for  particular  positions.  In  order  to 
be  considered  for  certain  positions,  evaluation  at  an  assessment  center  has  become  a 
prerequisite. 

Where  and  how  often  are  assessments  conducted? 

Most  centers  are  conducted  away  from  the  participants  workplace,  sometimes  in  a 
place  where  all  the  candidates  and  assessors  are  housed  in  the  same  area  and  remain  in 
close  contact  throughout  the  entire  evaluation  period. 

Participation  can  be  anything  from  a  one-time  event  in  a  candidates  hfetime,  to  a 
periodic  assessment  conducted  at  approximately  four  year  intervals.  Some  organizations 
have  full  time  assessment  centers  that  operate  continuously,  while  others  run  only 
periodically  throughout  the  year.  The  time  an  individual  participant  spends  at  an 
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assessment  center  in  a  single  visit  varies  from  one  to  six  days,  with  the  average  being 
about  three. 

If  a  center  is  being  used  strictly  for  selection  purposes,  the  evaluation  time  will 
typically  be  shorter  than  one  designed  to  provide  feedback  on  an  individual’s  strengths  and 
weaknesses.^’ 

Validity  and  Acceptance  of  Results 

One  of  the  most  attractive  features  of  the  assessment  center  approach  is  the  vahdity 
and  acceptance  of  the  evaluations  they  produce.  The  most  authoritative  research  on  the 
assessment  center  process  was  the  Management  Progress  Study  mentioned  earher.  The 
study  assessed  male  employees  at  AT&T  beginning  in  1956.  The  results  of  the  study  were 
reviewed  eight  years  later  to  compare  the  predictive  results  of  the  assessments  with  the 
actual  progress  made  by  the  participants.  “Of  the  total  number  of  men  who  reached 
middle  management,  78  percent  were  correctly  identified  by  the  assessment  staff.  In 
contrast,  among  those  in  both  groups  who  had  not  progressed  further  than  first  level 
management,  the  assessors  predicted  that  95  percent  would  not  reach  middle  management 
within  ten  years. Clearly,  this  represents  high  validity  for  the  process. 

Acceptance  of  the  results  by  the  people  being  assessed  is  also  important.  Objectivity 
and  the  absence  of  bias  are  crucial  if  the  process  is  to  be  accepted.  The  assessment  center 
process  is  one  of  the  most  sophisticated  formal,  objective  evaluation  processes  in  existence 
today.  There  is  a  common  misperception  in  the  mihtary  that  evaluation  techniques  are  by 
nature  subjective,  due  in  part  to  famiharity  with  the  officer  and  NCO  evaluation  systems 
(OPRs  and  EPRs).  However,  assessment  center  evaluations  contrast  quite  sharply  with 
the  military  evaluation  systems: 


18 


Assessments 


Evaluations  (QPR/EPR) 


Evaluates  student  behaviors 
Predicts  future  abilities 
Nonthreatening,  uninflated 

Requires  trained  assessors 

Measurement  tools  are  standardized, 
validated  and  quantifiable 
Assessor  bias  unlikely  because 
judgment  calls  are  minimized 


Evaluates  performance  on  the  job 
Usually  measures  past  results 
May  be  threatening,  inflation 
common 

Requires  senior/subordinate 
relationship 

Measurement  tools  may  not  apply  to 
anyone  other  than  person  evaluated 
Requires  judgments  and  may  be 
biased 


Surveys  have  also  shown  that  the  assessment  center  results  are  unbiased  in  terms  of 


sex  and  race.  Overall  levels  of  performance  of  men  and  women  did  not  differ;  similarly,  the 
results  of  blacks  tested  were  comparable  to  those  of  whites.^'’  Assessor  bias  is  minimized 


due  to  two  factors:  (1)  assessors  are  not  in  the  rating  chain  of  the  candidates,  and  (2) 


multiple  assessors  evaluate  each  participant  to  eliminate  any  individual  biases  in  the  overall 
feedback.^^ 


“The  assessment  center  approach  seems  to  have  substantial  vahdity  for  long-range 
predictions  of.. .success  across  many  different  organizations  and  specific  job  situations,  and 
it  appears  to  be  highly  useful  in  providing  opportunity  to  the  most  capable  in  an  unbiased 
manner;  furthermore,  it  is  a  popular  method  with  both  management  and  employees. The 
apphcabihty  to  developing  leadership  skills  in  acquisition  personnel  and  the  potential  to 
use  this  evaluation  tool  as  a  selection  criteria  for  Program  Directors  is  obvious.  What 
remains  is  to  recommend  an  implementation  strategy  for  AEMC.  This  subject  will  be 
covered  in  Chapter  4. 
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Chapter  4 


A  Potential  AFMC  Assessment  Center  Scenario 

The  following  scenario  represents  the  author’s  opinion  of  what  would  constitute  an 
effective  implementation  of  assessment  center  methodologies  in  AFMC  to  support  the 
development  and  nurturing  of  critical  skills  (both  leadership  and  management)  in  Air  Force 
and  Civil  Service  personnel  in  the  acquisition  management  career  field. 

Location 

The  “acquisition  world”  is  relatively  small,  with  the  vast  majority  of  personnel  in  the 
career  field  stationed  at  a  small  number  of  locations  within  the  continental  United  States: 
Wright-Patterson,  Eghn,  Hanscom,  Los  Angeles,  and  Brooks  AFB  are  the  homes  of  the 
five  primary  systems  centers  responsible  for  major  Air  Force  acquisitions.  Smaller 
numbers  of  personnel  are  stationed  at  other  locations  (most  notably  the  Pentagon  in 
Washington  DC),  but  they  represent  only  a  fraction  of  the  total  workforce.  AFMC 
Headquarters  is  collocated  with  the  Aeronautical  Systems  Center  (the  largest 
concentration  of  acquisition  personnel  in  the  Air  Force)  at  Wright  Patterson  AFB,  OH. 

Estabhshing  the  AFMC  Assessment  Center  at  the  headquarters  is  obviously  the  most 
logical  choice.  Serving  a  command  wide  function  suggests  that  the  Center  would  best  be 
located  at  HQ  AFMC.  Under  the  current  AFMC  organization,  the  Assessment  Center 
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would  be  most  appropriately  plaeed  in  the  Personnel  Direetorate  (DP)  as  a  three  letter 


division. 


Staffing 

The  Assessment  Center  should  be  seleetively  manned  with  a  eadre  of  instruetors 
ranging  in  rank  from  ILt  through  Colonel  and  GS-11  through  15,  to  ensure  that 
partieipants  (regardless  of  rank  or  grade)  will  always  be  in  eontaet  with  a  variety  of 
assessors  that  would  be  eonsidered  peers,  subordinates  and  superiors. 

The  amount  of  training  given  to  assessors  ean  vary  anywhere  from  five  hours  to 
fifteen  days.^  Beeause  these  personnel  will  be  doing  this  work  on  a  full  time  basis,  a  three 
week  training  eourse  would  be  appropriate. 

It  has  been  generally  aeeepted  that  assessors  ean  provide  more  aeeurate  evaluations 
when  they  do  not  personally  know  the  partieipants,  as  this  allows  the  assessor  to  remain 
unbiased  and  uninvolved  emotionally.^  Speeifie  behaviors  to  be  evaluated  have  been 
identified  and  the  assessor  has  been  trained  to  observe  them.  Relative  anonymity  supports 
this  proeess.  Therefore,  assessors  who  have  been  direet  supervisors  or  subordinates  of  the 
partieipants  in  previous  assignments  will  be  replaeed  in  exereises  that  involve  those 
individuals. 

While  assessments  are  done  for  the  partieipants,  the  assessors  benefit  as  well. 
Through  the  experienee  of  being  an  assessor,  individuals  appear  to  beeome  more 
sophistieated  in  making  judgments,  enhaneing  their  management  and  leadership  abihties 
when  they  return  to  a  regular  duty  assignment.^ 
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Competencies 


The  goal  of  the  AFMC  Assessment  Center  should  be  to  develop  leaders  for  all  levels 
in  the  Air  Force,  with  some  tailoring  for  the  unique  environment  encountered  in  AFMC. 
Therefore,  the  competencies  that  define  effective  performance  will  be  leadership  based, 
with  some  management  techniques  added  to  customize  the  assessments  for  acquisition 
personnel. 

In  1989  the  Defense  Systems  Management  College  conducted  a  study  of  the  major 
competencies  possessed  by  effective  program  managers  in  the  defense  acquisition  process. 
The  study  included  in-depth  interviews  with  over  50  DOD  program  managers  and  a 
foUow-on  survey  of  over  500  acquisition  professionals.  The  results  were  used  to  update 
the  DSMC  curriculum,  but  are  also  valuable  to  acquisition  organizations  in  their  attempts 
to  measure  effective  performance."^  The  following  hst  represents  the  six  major 
competencies  (with  their  definitions)  that  the  study  identified  that  distinguished 
outstanding  program  managers  from  merely  effective  ones:^ 

1.  Sense  of  Ownership/Mission:  Sees  self  as  responsible  for  the  program  and 
articulates  problems  or  issues  from  a  broader  organizational  or  mission  perspective 

2.  Pohtical  Awareness:  Knows  who  influential  players  are,  what  they  want  and  how 
best  to  work  with  them 

3.  Relationship  Development:  Spends  time  and  energy  getting  to  know  program 
sponsors,  users,  and  contractors 

4.  Strategic  Influence:  Builds  coahtions  and  orchestrates  situations  to  overcome 
obstacles 

5.  Interpersonal  Assessment:  Identifies  specific  interests,  motivations,  strengths  and 
weaknesses  of  others 

6.  Action  Orientation:  Reacts  to  problems  energetically  and  with  a  sense  of  urgency 

These  six  competencies  represent  key  leadership  traits  that  have  an  “acquisition  twist” 

to  them.  To  these  six,  five  additional  traits  will  be  added,  all  of  these  taken  from  the 
LADP  list  enumerated  earlier: 
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1.  Communications  (both  written  and  verbal) 

2.  Supervision 

3.  Teaching  and  counseling 

4.  Decision  making 

5.  Professional  ethics 

Together,  this  combined  hst  constitutes  the  core  of  the  AFMC  Assessment  Center 
organizational  leadership  competency  hst.  While  some  “management  type”  functions  are 
addressed,  these  competencies  have  a  decidedly  leadership/interpersonal  slant.  Other 
training  that  acquisition  personnel  receive  over  time  wiU  take  care  of  the  process  skiUs, 
while  this  assessment  center  will  hone  the  interpersonal  side. 

Evaluation  Opportunities 

Developing  good  leadership  habits  and  traits  is  something  that  does  not  happen 
overnight.  Periodic  visits  to  the  AFMC  Assessment  Center  should  be  mandatory  for  ah 
mihtary  and  civihan  personnel  in  the  acquisition  career  field.  An  initial  visit  before 
reporting  to  a  first  duty  assignment  should  be  accomphshed  to  give  the  participant  a 
baseline  look  at  the  abihties  one  has  going  into  a  new  career.  Mihtary  can  be  sent  TDY 
enroute  to  the  first  acquisition  assignment,  while  civihans  wih  have  to  be  sent  after  starting 
the  job  at  their  organization. 

Return  visits  for  further  feedback  should  be  accomphshed  before  each  new 
assignment  (TDY  enroute)  or  every  4  years,  whichever  is  less.  For  ranks  of  2Lt  through 
Captain,  and  GS-9  through  GS-12,  the  purpose  of  the  assessments  wih  be  strictly  for 
feedback  to  help  the  junior  personnel  develop  an  effective  leadership  style  by  providing 
evaluations  in  a  nonthreatening  environment.  However,  Majors  and  GS-13’s  and  above 
wih  not  only  get  the  feedback  for  their  own  personal  use,  but  a  file  wih  be  maintained  at 


24 


the  Assessment  Center  on  them,  reflecting  their  performance  in  the  exercises  and  their 
overall  marks  in  the  eleven  core  competencies.  These  files  wiU  be  provided  to  AFMC/DP 
for  the  records  review  that  they  conduct  when  screening  personnel  for  Program  and 
Deputy  Program  Director  positions.  The  absence  of  a  current  evaluation  (within  four 
years)  in  this  file  wiU  disquahfy  an  apphcant  from  further  consideration  for  a  senior 
acquisition  biUet.  This  wiU  ensure  not  only  that  the  candidate  receives  timely  feedback  on 
his  leadership  abihties,  but  it  provides  AFMC  with  an  objective  measure  of  the  individual 
to  use  as  a  selection  criteria  (along  with  performance  reports,  duty  history,  center 
commander  inputs,  etc.)  for  filling  critical  program  office  positions. 


Notes 

^Francis,  pg.  10. 

^Ibid.,pg.  11. 

^Ibid.,pg.  11 

"^Dr.  Owen  C.  Gadeken,  “DSMC  Studies  Program  Manager  Competencies”  Program 
Manager  nl,  Jan-Feb  1989,  pg.  42. 

^Dr.  Owen  C.  Gadeken,  and  others,  “Program  Managers  with  the  Right  Stuff’, 
Program  Manager  \19  n3,  May-Jun  1990,  pg.  27. 
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Chapter  5 


Conclusion 

The  Air  Force  acquisition  community  has  moved  away  from  the  development  of 
leaders  in  favor  of  cultivating  efficient  managers.  Some  believe  that  it  is  a  symptom  of  a 
greater  Air  Force  problem  of  careerism  and  dependence  on  speciahsts.  Whatever  the 
reason,  the  current  environment  demands  a  return  to  the  basics  of  leadership  if  the  mission 
is  to  be  accomplished  effectively. 

“The  decade  of  the  1990’s  brings  with  it  challenges... unique  in  their  complexities. 
Breathtaking  technological  advances,  the  starthng  pace  of  pohtical  change  sweeping  the 
world  and  increasing  demands  on  shrinking  resources  all  combine  to  make  these 
challenges  even  more  imposing  on  our  senior  civihan  and  mihtary  leadership.  We  must 
ensure  that  the  leaders  of  our  smaller  force  possess  the  right  skills,  knowledge  and 
attitudes  enabhng  them  to  be  effective  in  any  environment.  They  must  be  participants  in  a 
rigorous  development  and  assessment  program  that  prepares  them  to  function  not  only  at 
their  present  levels  of  responsibility  but  at  one  or  two  echelons  higher.”^ 

The  estabhshment  of  an  assessment  center  at  AFMC  Headquarters  can  bring  some 
much  needed  refocusing  on  the  skills  and  attributes  that  are  truly  critical  to  the 
accomphshment  of  AFMC’s  mission  of  acquiring  world  class  weapon  systems  for  the 
warfighter  in  the  21st  century.  In  addition  to  a  reprioritization  of  the  skills  needed  to  be 
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effective,  the  assessment  center  can  provide  critical  selection  criteria  to  the  decision 
makers  who  appoint  future  Program  Directors.  Objective  measures  of  leadership  are  an 
essential  tool  for  ensuring  the  right  person  is  given  the  task  of  leading  our  major  weapon 
system  acquisition  programs.  These  are  the  impacts  that  an  AFMC  Assessment  Center 
can  have  on  the  future  of  the  Air  Force. 

Notes 

^Palmer,  “Developing...”,  pg.  43. 
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